Papers with multimodal classification tasks
CrowdAgent: Multi-Agent Managed Multi-Source Annotation System (2025.emnlp-demos)
Copied to clipboard
Maosheng Qin, Renyu Zhu, Mingxuan Xia, null Chenchenkai, Zhen Zhu, Minmin Lin, Junbo Zhao, Lu Xu, Changjie Fan, Runze Wu, Haobo Wang
| Challenge: | Recent approaches to annotate data focus on labeling, but lack holistic process control . a novel system that integrates task assignment, data annotation, and quality/cost management is needed . |
| Approach: | They propose a multi-agent system that integrates task assignment, data annotation, and quality/cost management. |
| Outcome: | The proposed system automates human management by using a collaborative multi-agent system. |
Revisiting Multimodal Transformers for Tabular Data with Text Fields (2024.findings-acl)
Copied to clipboard
| Challenge: | Tabular data with text fields can be used in financial risk assessment and diagnosis prediction. |
| Approach: | They propose a tabular/text dual-stream Transformer network with numerical embedding schemes and an overall attention module to estimate whether a prediction is uncertain. |
| Outcome: | The proposed model can estimate whether a prediction is uncertain or not based on two well-informed modality streams . |
Borrowing Human Senses: Comment-Aware Self-Training for Social Media Multimodal Classification (2022.emnlp-main)
Copied to clipboard
| Challenge: | Social media users are using images and text to voice opinions and share ideas. |
| Approach: | They propose to use user comments to extract hinting features from user comments and explore them via self-training. |
| Outcome: | The proposed framework improves on four social media benchmarks for image-text relation classification, sarcasm detection, sentiment classification, and hate speech detection. |